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Method and Apparatus for Enhancing 
Television Programs With Event Notifications 



BACKGROUND 
10 1. FIELD 

The present invention relates generally to digital television and broadcast 
systems and, more specifically, to providing event notifications for digital 
television programs. 



15 2. DESCRIPTION 



Q 



The broadcasting industry is expanding into digital broadcast technologies 
that promise new features, higher resolution video and audio, and other 
f technological enhancements. Digital television (DTV) broadcasting provides at 

□ least several advancements in broadcast content enhancement. One type of 

"'*.'f; 

Pi] 20 content enhancement is the addition of supplemental information to the regular 
broadcast transmission. Supplemental information can take many forms, such 
as Hypertext Markup Language (HMTL), meta-data, and other information 
carrying data structures. Enhanced or interactive television incorporates the 
supplemental information into the viewing experience through interactive 
25 displays, links to web pages on the Internet, and other features. 

The Advanced Television Enhancement Forum (ATVEF) (www.atvef.org ) 
is a cross-industry alliance of companies representing broadcast and cable 
networks, television transports, the consumer electronics industry, and the 
personal computer (PC) industry. ATVEF has defined protocols for HTML-based 
30 enhanced television, which allow content creators to deliver enhanced 
programming over all forms of transport (analog, digital, cable, Internet and 
satellite) to intelligent receivers. ATVEF has published the Enhanced Content 
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Specification, version 1.1, revision 26, 1998-2000 (hereinafter referred to as the 
"ATVEF Specification") to promote consistent methods for providing 
enhancements in both analog and digital broadcasting systems. The ATVEF 
Specification provides a standard for delivering interactive TV experiences that 
5 can be authored once using a variety of tools and deployed to a variety of TV, 
set top box, and PC-based receivers. The ATVEF Specification specifies 
content formats and delivery mechanisms for the transmission and processing of 
triggers, resources, announcements, and content that are associated with an 
enhanced TV transmission. Such enhancements are often suitable for use by a 
10 computer system (such as a PC), connected to the Internet or other network. 
For example, one type of supplemental information is a Universal Resource 
p Locator (URL) to a TV network's web site where additional information relating to 
;^ a TV program may be found. In one scenario for enhanced TV viewing, a viewer 
H may watch a TV program and be notified of a related web site. The viewer may 

l'p 15 then obtain one or more web pages from the identified web site and display them 
^ either on the TV screen or on another display concurrently with viewing the TV 

m program. 

=y When viewers watch TV, it is common for the viewers to follow multiple 

[ ]f programs on different channels concurrently. For example, a person might be 

O 20 watching a movie on one channel while periodically checking the score of a 
! football game shown on another channel. In another example, a family watching 

a national news program on a cable channel might want to switch to a local 
channel when the local weather report is broadcast. Currently, picture in picture 
(PIP) technology allows viewers to monitor programs on two channels 
25 simultaneously by using two tuners, each tuner receiving one channel and 
displaying the received program on a selected area of the TV screen. However, 
there is no mechanism for notifying viewers of interesting program events 
happening on multiple channels when only one program is being displayed. 
Thus, the viewer must frequently switch back and forth between channels to 
30 monitor what is being shown on different channels. This unnecessarily interrupts 
viewing of the primary program currently being watched by the TV viewer. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

5 The features and advantages of the present invention will become 

apparent from the following detailed description of the present invention in which: 

Figure 1 is a diagram of a system for providing event notifications 
according to an embodiment of the present invention; and 
10 Figure 2 is a flow diagram illustrating providing and processing of event 

notifications according to an embodiment of the present invention. 

DETAILED DESCRIPTION 

15 

An embodiment of the present invention improves enhanced TV 
programming such that TV viewers watching one channel may be notified of 
interesting programming events happening or about to happen on other 
channels. The present invention overcomes the problem addressed by "surfing 

20 TV channels" by providing notifications that alert enhanced TV viewers to other 
programming events happening or about to happen on different channels that 
are not presently being watched. This enables the viewer to watch a primary 
program on one channel without interruption and be timely notified about 
interesting programming events about to occur on other channels. The viewer 

25 then may have the option of switching to another channel based on the 
information included with the event notification. 

Reference in the specification to "one embodiment" or "an embodiment" of 
the present invention means that a particular feature, structure or characteristic 
described in connection with the embodiment is included in at least one 

30 embodiment of the present invention. Thus, the appearances of the phrase "in 
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one embodiment" appearing in various places throughout the specification are 
not necessarily all referring to the same embodiment. 

Figure 1 is a diagram of a system for providing event notifications 
according to an embodiment of the present invention. A television (TV) 10 may 
5 be coupled to a set top box 12 for receiving digital TV (DTV) broadcasts via a 
broadcast network 14. The set top box may be configured to receive digital 
broadcast TV signals via a broadcast network comprising an antenna, cable, 
satellite dish, a computer network (such as the Internet for example), or any 
other suitable transmission mechanism. In some embodiments, the set top box 
10 may be integral with the TV 10 or other associated consumer electronics or 
computer products. 

Set top box 12 comprises ATVEF receiver 16. The receiver decodes and 
plays ATVEF content. Generally, the ATVEF receiver may be a software product 
being executed by a processor within the set top box, but may also comprise 
II 15 hardware circuitry within the set top box. In one embodiment, the ATVEF 
receiver processes the DTV broadcast signal to extract enhanced content in 
accordance with the ATVEF Specification. Extraction of enhanced content may 
comprise, at least in part, processing the received DTV signal to strip the 
received signal of triggers, execute a software script, segregate data or data 

sit" 

3 20 structures, or other methods of separating data into groupings. Enhanced 
content extracted from a DTV broadcast signal may include a variety of 
enhanced TV resources such as ATVEF triggers to update information displayed 
on a visual display (such as the screen of TV 1 0 or another monitor), Universal 
Resource Locators (URLs), metadata, scripts, Java applets, HTML, web pages, 
25 images, or other useful data. The TV viewer may then interact with the 
enhanced content obtained from the set top box and TV to enrich the viewing 
experience. For example, enhanced TV broadcasts may use triggers and scripts 
to change the banners on web pages to tie in with a TV program or to change 
web pages being displayed on a portion of the TV screen or other monitor 
30 communicatively coupled with the TV or set top box. 
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Broadcast head-end 18 broadcasts the DTV signal to the set top box 12 
over the broadcast network 14 using well known methods. The broadcast head- 
end accepts an enhanced TV stream 20 which may be reformatted by the 
broadcast head-end into the DTV signal broadcast over the broadcast network. 

5 The broadcast head-end may also be known as a transport operator. A 
transport operator runs a video delivery infrastructure that includes a transport 
for ATVEF data. The enhanced TV stream 20 may be created by a content 
creator (not shown). The content creator originates the content components of 
the enhancement including audio, video, graphics, layout, interaction and 

10 triggers. The content creator creates the enhanced TV stream to comprise the 
TV content 22 (e.g., one or more TV programs having at least audio and video 
portions) and zero or more ATVEF triggers 24. The content creator may be a 
broadcasting network, a TV production company, or other television 
programming entity. In one embodiment, the content creator may be the same 

15 entity as the entity operating the broadcast head-end or transport operator. As 
noted above, enhanced TV allows a content creator to integrate TV programs 
with relevant data enhancements. The ATVEF Specification provides content 
creators with a reliable definition of how to deliver enhanced programming over a 
variety of transport mechanisms to compliant receivers. Some embodiments of 

20 the present invention use the protocol defined by the ATVEF Specification to 
create program event notifications and deliver them to any intelligent and 
compliant receiver, such as set top box 12. In some embodiments, event 
notifications 26 may be data enhancements implemented as ATVEF packages 
and triggers that may be executed at the receivers (e.g., set top boxes and/or 

25 TVs). 

ATVEF triggers are described in the ATVEF Specification in section 1.1.5. 
Triggers are real-time events delivered for an enhanced TV program. In one 
embodiment, a trigger may be included in a single Internet Protocol (IP) multicast 
packet delivered on the address and port defined in an announcement for an 
30 enhanced TV program. In another embodiment for analog TV, triggers may be 
transmitted on vertical blanking interval (VBI) line 21 of a National Television 
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Standards Committee (NTSC) television signal. ATVEF Receiver 16 may set a 
policy for allowing users to turn on or turn off enhanced TV content, and can use 
a trigger arrival as a signal to notify users of enhanced content availability. 
Triggers may include a URL, and may optionally include a human-readable 
5 name, an expiration date, and a script. The ATVEF Receiver determines how to 
interpret triggers received from the broadcast head-end. In the present 
invention, the ATVEF Receiver may interpret a received trigger as an event 
notification of something of interest happening or about to happen in a program 
being broadcast on a channel other than the one currently being viewed. 
10 In order to alert viewers to interesting events happening or about to 

happen on other channels not currently being watched, the events must first be 
identified. Content creators for TV programming may decide in advance which 
program segments constitute interesting events for a viewer. In one 
embodiment, an event may signify the starting of a program segment. In another 
Ji 15 embodiment, an event may signify that a program segment may be commencing 
after a predetermined time period from the current time (e.g., program segment 
X starts on channel Y in 30 seconds from now). Generally, selected portions of 
each TV program may be identified as separate discrete events to be registered 
for by a viewer. For example, in a news program, possible events may comprise 
20 presentation of the national news, the local news, the national weather report, 
the local weather report, sports scores, sports highlights, daily financial 
information, local human interest stories, and so on. In another example, in a 
sports program such as the broadcasting of a football game, possible events 
may comprise scoring plays, the two minute warning, plays gaining over 20 
25 yards, long passes, interceptions, fumbles, and so on. In yet another example, 
in a drama program, possible events may comprise important scenes furthering 
the plot of the program. As can be appreciated, any portion of any TV program 
may be identified as an event of interest to a viewer. Each event may be 
assigned a globally unique identifier. Furthermore, the portion of the TV program 
30 may be pre-recorded, or may be part of a live broadcast. For a live broadcast, 
events occurring in real-time may be tagged or otherwise identified as they 
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happen, either manually or automatically, by the broadcast head-end or content 
creator. 

In one embodiment, viewers may subscribe or register for event 
notifications through a user interface available at the set top box. For example, 
5 the viewer may be presented with a list of events on the TV or other monitor for 
one or more selected programs on one or more selected channels of interest 
(e.g., show all news segment events of a local news program). In one 
embodiment, a dedicated TV channel may be used for advertising program 
events. The viewer may select this channel to view a list of events to register or 
10 subscribe to. In another embodiment, the events may be identified in printed 
form, such as in a daily newspaper, or a magazine, or a program guide, or in an 
electronic form such as an electronic program guide (EPG). The viewer may then 
select, using any suitable user interface communicatively coupled with the set 
top box, zero or more events. For example, the viewer may select events of 
II 15 interest using well-known user interface mechanisms such as using a TV remote 
control or a mouse. The selected events may be compiled and stored by the set 
top box as the set of registered events for a given viewer. 

The set top box may in some embodiments store individual sets of 
registered events for multiple viewers. In this case, a viewer may need to identify 
20 himself or herself to the set top box when starting watching TV so that the set top 
box knows which events are currently of interest. When an event occurs that is 
of interest to a current viewer, the set top box may present a notification of the 
event to the viewer. The set top box may parse or filter event notifications 
received from the broadcast head-end over the broadcast network to take further 
25 action on only those events selected as interesting by the current viewer. 

In one embodiment, the notification may comprise a visual signal to the 
viewer that an event of interest has occurred. The event may indicate that 
something of interest is occurring or about to occur. For example, a banner may 
appear textually informing the viewer of the event. In other embodiments, the 
30 notification may be audible. The viewer may then change the channel as 
desired. In one embodiment, the channel being viewed may be automatically 
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changed by the set top box to another channel when the event occurs (e.g., 
change the currently displayed channel to the channel having the desired event). 
This causes the primary program being displayed for viewing by the viewer to be 
changed to display another program. In one embodiment, the program from the 

5 new channel may be displayed in one portion of the TV screen concurrently with 
the display of the existing primary program in another portion of the screen. 

The set of events registered for by a viewer may occur on multiple 
channels. For example, a viewer may desire to register for ten different events, 
with two events potentially occurring in programs broadcast on channel 4, four 

10 events potentially occurring in programs broadcast on channel 11, one event 
potentially occurring in a program broadcast on channel 32, and three events 
potentially occurring in programs broadcast on channel 156. In addition, a single 
event may in some instances occur on more than one channel. In that case, the 
viewer may be presented with a choice of channels in order to view the program 



|i 15 segment associated with the event. 
2 There may be at least three transport mechanisms used in embodiments 



of the present invention for sending event notifications to a viewer. In one 
embodiment, the set top box or TV includes two tuners. One tuner may be used 
to receive the TV program currently being watched, while the second tuner is 

20 typically used for a value added service such as PIP. Instead of PIP however, in 
some embodiments of the present invention the second tuner tunes to a second 
broadcast channel that carries current event notifications sent from the 
broadcast head-end to the set top box. In another embodiment, the set top box 
or TV may include only one tuner (for receiving the TV program being watched), 

25 but the viewer also has one or more other devices (such as a PC, consumer 
electronics equipment, cell phone, personal digital assistant (PDA), and the like) 
having a connection to a communications network such as the Internet. In this 
case, an Internet protocol (IP) multicast channel may be used as a transport 
mechanism to deliver event notifications in ATVEF triggers to the viewer's site. 

30 As shown in Figure 1, the ATVEF triggers representing event notifications 

may be communicated in data packets through the Internet to a computer 
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system 30 communicatively coupled to the set top box. Although represented as 
computer system 30 in Figure 1, this device may be any computing device 
capable of receiving data over a network such as the Internet, in one 
embodiment, the set top box connects to the Internet for receiving the ATVEF 

5 triggers and a separate computer system is not used. In still another 
embodiment, the set top box or TV includes only one tuner and there is no 
network connection. In this case, event notifications may be sent on the same 
TV channel along with the primary program. This may require broadcasters to 
cooperate by providing bandwidth on their channels to other broadcast networks 

10 for carrying event notifications for a plurality of programs and channels. For 
DTV, the broadcast signal may include data packets having event notification 
data relating to events on other channels. 

Although ATVEF and ATVEF triggers are discussed herein as a transport 
mechanism for conveying the event notifications to the viewer, the invention is 

15 not limited in scope in this respect. Any communications protocol, now known or 
developed in the future, that communicates the event notifications from the 
broadcast head-end to the set top box and/or TV in a timely manner may be 
employed. 

Figure 2 is a flow diagram illustrating providing and processing of event 
20 notifications according to an embodiment of the present invention. At block 50, 
the broadcaster or content creator defines events for a program to be or being 
broadcast. In one scenario, a broadcaster or content creator may define a set of 
events for every prerecorded program in a broadcast schedule. For example, if 
a cable TV or satellite TV company operates a broadcast network having 
25 multiple channels, the cable TV or satellite company may define the events for 
all programs broadcast on all channels or any subsets thereof. The broadcaster 
may also define events in real-time for live shows (e.g., sports events, major 
news events, and so on). 

An event, in general, may be anything happening or about to happen in a 
30 program. In one embodiment, the description of an event may be prescribed or 
standardized throughout the broadcast industry. For example, extended markup 
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language (XML) or another suitable descriptive language may be used to define 
a schema of event descriptions that may be used by all broadcasters and 
content creators. 

In one simple illustrative, non-limiting example, an event description 
5 definition may be: 



<program> ProgramJMame </program> 
<fragment> Event_Name </fragment> 
<event_type> Event_Type_Name </eventJype> 
10 <channel> ChannelJMame </channel> 

whereas, a corresponding specific event description may be: 

W 

41 <program> College Football Weekly Game</program> 

hQ 15 <fragment> Scoring J^layJTouchdown </fragment> 

M <event_type> SportsJ-lighlights </event_type> 

O <channel> Channel_148 </channel> 

4" In a more detailed example, in one embodiment of the present invention, 

H 20 a schema for defining events representing program segments may be: 

'"4 

!,!* <program name-'" channel-'" network=""> 

<fragments> 
2 <fragment> 

25 <eventjiame></event_name> 
<event_type></event__type> 
<event_description></event_description> 
</fragment> 



30 

</fragments> 
</program> 

<AttributeType name-'name" dt:type="string" /> 

35 <AttributeType name="channel" dt:type="string" /> 
<AttributeType name="network" dfctype- 'string" /> 
<ElementType name-'event^name" content-'textOnly" dt:type="strlng" /> 
<ElementType name="event_type" content="textOnly" dt:type="string H /> 
<ElementType name="event_description" content-'textOnly" dt:type="string" 

40 /> 
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<ElementType name="fragment" content="eltOnly" order="many"> 
<element type-'evenOiame" minOccurs-T maxOccurs='T /> 
<element type="event_type" minOccurs-T' maxOccurs- T' /> 
5 <element type- f event_description" minOccurs="0" maxOccurs="1" /> 

</ElementType> 

<ElementType name="fragments" content="e!tOnly" order="many"> 
<element type="fragment" minOccurs="0" maxOccurs-'*" /> 
10 </ElementType> 

<EIementType name="program" content="eltOnly" order="many"> 
ottribute type="name" required="yes" /> 
<attribute type= ,, channel" required="yes" /> 
1 5 <attribute type="network" required-'yes" /> 

<element type-'fragmerits" minOccurs= H 0" maxOccurs-T' /> 
n </ElementType> 

.p Here are two examples of using this definition of an event representing a 

U 20 program segment: 

■ ! 5SS- 

U1 <program name- 'News Channel 8" channel="8" network="NBC"> 

^ <fragments> 
;; P <fragment> 

1. 25 <event_name>Local Weather</event_name> 

H <evenMype>News_Weather_Report</eventJype> 

i« i <event__description>Weather with Michael Smith</event_description> 

S </fragment> 

3 <fragment> 

30 <event_name>Sports Channel 8</event_name> 

<event_type>News_Sports_Report</event_type> 
<event_description>Sports News with John Smith</event_description> 
</fragment> 
</fragments> 
35 </program> 

<program name-'Monday Night Football" channel="2" network="ABC"> 
<fragments> 
<fragment> 

40 <eventjiame>Scoring Play Touchdown</event_name> 

<event_type> S ports J^otballJTouchdown </event_type> 
<event_description> 

Scoring Touchdown Info and Current Score 
</event_description> 
45 </fragment> 
<fragment> 
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<eventjriame>Scoring Play Field Goal</event_name> 

<event_type>Sports_Football_Fielcl_Goal</event_type> 

<event_description> 

Scoring Field Goal Info and Current Score 
5 </event_description> 
</fragment> 
</fragments> 
</program> 

10 

An example of a schema for defining an event notification follows: 

<event_notification name-" channel-'" network=""> 

<event_name></event_name> 
1 5 <event_type></event_type> 

<event_description></event_description> 
<event notification> 

O 

<AttributeType name="name" dt:type="string" /> 
20 <AttributeType name= n channel" dt:type="string" /> 
2 <AttributeType n a me =" network" dt:type="str!ng" /> 

G <AttributeType name="real — time" dt:type="boolean" /> 

|»n <ElementType name= ,, event_name" content="textOnly" dt:type="string" /> 

S <ElementType name="event_type H content="textOnIy" dt:type= ,, string" /> 

«J! 25 <ElementType name="event_description" content="textOnly" dt:type="string" 

!i /> 

iassl 

! %I <ElementType name="event_jiotifIcatIon" content="eltOnly" 

Ftj order= " many" > 

Q 30 ottribute type="name" requi redeyes" /> 
□ ottribute type="channel M required ="yes M /> 

[»& <attribute type=" network" required="yes" /> 

<attribute type="real_time" required= M yes" /> 
<element type-" eve nt_name" minOccurs= n l n maxOccurs="I" /> 
35 <element type="event_type" minOccurs="l" maxOccurs="l" /> 

<element type="event_description" minOccurs="0" maxOccurs="l" 
/> 

</ElementType> 

40 

Here are two examples of using this definition of an event notification: 

<event_notification name="News Channel 8" channel= w 8" network="NBC" 
realjime="0"> 

45 <event_name>Local Weather Report</event_name> 
<event_type> News_WeatherJReport </event_type> 
<event_description> 

Weather with Michael Smith: Tornado Alert for Monday July 9, 2001 
</event_description> 
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</event_notification> 

<event_notification name="ABC Monday Night Football" channel="2" 
network="ABC" realjime="1"> 
5 <eventjiame>Scoring Play Touchdown</event_name> 
<event_type>Sports_Football_Touchdown</event_type> 
<event_description> 

Jack Smith of Miami Scores a Touchdown. New York 10 : Miami 13 
</event__description> 
1 0 </eventjiotification> 



Once the events and corresponding event notifications are defined by the 
broadcaster or content creator, in one embodiment the event definitions may be 
communicated to the set top box, either via the broadcast network or via a back 
15 channel such as the Internet or telephone line. The set top box receives the 

Q 

$ event definitions and presents them to the viewer for selection. Alternatively, the 

£f event definitions may be presented to the viewer in some other form, such as a 
P printed publication distributed through the mail or by other means, or an 

%J electronic program guide. At block 52 of Figure 2, the viewer uses a user 

" r 20 interface operated by the set top box to select events of interest for one or more 
:<3 programs. At block 54, prior to or contemporaneous with broadcasting of 

ry programs, the broadcaster or content creator generates event notifications for 

!»{ events occurring in the programs being broadcast. This may be done for all 

'issr 

i ;4 programs on all channels or any subset thereof. In one embodiment, the event 

25 notifications comprise ATVEF triggers. At block 56, the broadcaster creates the 
enhanced TV stream by combining the TV content with the generated event 
notifications (e.g., ATVEF triggers). At any given point in time, there may be zero 
or more event notifications for a portion of the enhanced TV stream. 

At block 58, the broadcaster broadcasts the enhanced TV stream, 
30 including the TV content (for one or more programs) and zero or more event 
notifications. Depending on the transport mechanism used, the event 
notifications may be transmitted over the Internet, on a selected specialized 
channel for event notifications, or embedded within the same channel as a 
program. Similar to a TV program, event notifications may be recorded and/or 
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replayed or rebroadcast. At block 60, the set top box receives the TV content 
over the broadcast network, and the event notifications over either the broadcast 
network or the Internet (via a computer system, the set top box itself, or another 
device). Once the set top box receives the event notifications, the set top box 
5 compares the received event notifications with the set of events of interest 
selected by the viewer. If any event is occurring or about to occur according to 
the received event notifications that matches or corresponds to a viewer selected 
event, the set top box alerts or otherwise notifies the viewer at block 62. At block 
64, the viewer may then change the channel to view the program event 
10 Optionally, the set top box may change the channel or cause the channel to be 
changed automatically (e.g., without viewer interaction). 

Thus, in one embodiment the present invention uses ATVEF triggers to 
allow a viewer to watch a TV program broadcast on one channel without 
f wi interruption, yet be automatically notified when selected events of interest occur 

!ji 1 5 in programs being broadcast on other channels. 

« The techniques described herein are not limited to any particular 

^ hardware or software configuration; they may find applicability in any computing 

: %l or processing environment. The techniques may be implemented in hardware, 

if; software, or a combination of the two. The techniques may be implemented in 

20 programs executing on programmable machines such as set top boxes, digital 
televisions, mobile or stationary computers, personal digital assistants, and 
similar devices that each include a processor, a storage medium readable by the 
processor (including volatile and non-volatile memory and/or storage elements), 
at least one input device, and one or more output devices. Program code is 
25 applied to the data entered using the input device to perform the functions 
described and to generate output information. The output information may be 
applied to one or more output devices. 

Each program may be implemented in a high level procedural or object 
oriented programming language to communicate with a processing system. 
30 However, programs may be implemented in assembly or machine language, if 
desired. In any case, the language may be compiled or interpreted. 
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Each such program may be stored on a storage medium or device, e.g., 
compact read only memory (CD-ROM), digital versatile disk (DVD), hard disk, 
magnetic disk, or similar medium or device, that is readable by a general or 
special purpose programmable machine for configuring and operating the 
5 machine when the storage medium or device is read by the computer to perform 
the procedures described herein. The system may also be considered to be 
implemented as a machine-readable storage medium, configured with a 
program, where the storage medium so configured causes a machine to operate 
in a specific manner. Other embodiments are within the scope of the following 
10 claims. 

While this invention has been described with reference to illustrative 
q embodiments, this description is not intended to be construed in a limiting sense. 
^ Various modifications of the illustrative embodiments, as well as other 
M embodiments of the invention, which are apparent to persons skilled in the art to 

;!S|S. 

Ji 15 which the inventions pertains are deemed to lie within the spirit and scope of the 
2 invention. 

□ 

■ w 

t Ss* 
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